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7  ■>.  Summary 
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-'For  symmetric  stable  sequences,  notions  of  innovation  and  Wold  decomposi¬ 
tion  (WD)  are  introduced,  characterized,  and  their  ramifications  in  prediction 
theory  are  discussed.  As  the  usual  covariance  orthogonality  is  inapplicable, 
the  non-symmetric  James  orthogonality  is  used,  thus  leading  to  right 

and  left  innovations  add  Wold  decompositions,  which  are  related  to  regression 
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prediction  and  least  p  moment  prediction,  respectively .  Independent  innova¬ 
tions  and  WD  are  also  character ized; and  several  examples  illustrating  the 
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0.  Introduction 


The  Wold  (or  orthogonal)  decomposition  of  Gaussian  and  other  second-order 

stochastic  processes  is  a  (fundamental)  tool  in  their  study,  and  in  particular 

in  their  predictions.  For  stable  and  other  p^-order  processes  (with  p  <  2) 

2 

the  lack  of  second  moments  renders  the  usual  L  notion  of  orthogonality  inap¬ 
plicable,  and  thus  orthogonal  decomposition  of  these  processes  does  not  even 
make  sense  a  priori.  There  are,  however,  notions  of  orthogonality  in  Banach 
spaces;  and  one  of  these,  due  to  G.  Birkhoff  and  popularized  by  R.C.  James 
[  5],  seems  appropriate  in  this  context.  Still,  the  situation  is  much  more 
complex  than  in  the  second-order  case,  as  we  shall  see  shortly. 

The  purpose  of  this  paper  is  to  examine  James'  orthogonality  in  the  con¬ 
text  of  symmetric  a-stable  (SaS)  random  variables  and  processes;  and  to  de¬ 
fine  appropriate  notions  of  Wold  decomposition  for  SaS  sequences  and  charac¬ 
terize  those  sequences  which  can  be  so  decomposed.  The  role  of  independence 
is  also  examined.  (Orthogonality  implies  independence  in  Gaussian  systems, 
but  not  in  stable  systems!) 

The  organization  of  the  paper  is  as  follows.  Section  1  includes  some 
preliminary  facts,  which  clarify  the  role  of  orthogonality  in  stable  systems. 
We  give  some  characterizations  of  orthogonality  (Corollary  1.3);  for  example, 
we  find  that  for  jointly  SaS  r.v.’s  X  and  Y,  X  is  orthogonal  to  Y  if  and  only 
if  E ( Y | X )  =0.  We  also  characterize  the  linearity  of  a  conditional  expectation 
in  a  stable  system  in  terms  of  an  appropriate  orthogonality. 

In  Section  2  we  define  two  kinds  of  innovations,  right  orthogonal  and 
left  orthogonal,  and  Wold  decompositions  for  SaS  sequences,  and  give  neces¬ 
sary  and  sufficient  conditions  for  their  existence.  It  turns  out  that  a 
right  Wold  decomposition  exists,  if  and  only  if  right  innovations  exist,  if 
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and  only  if  the  regressions  on  the  past  are  linear  (Theorem  2.3).  Left  in¬ 
novations  always  exist  (Proposition  2.8),  while  a  left  Wold  decomposition 
exists  if  and  only  if  the  metric  projections  on  the  past  are  linear  (Theorem 
2.10).  We  also  define  "non-linear"  innovations  and  Wold  decompositions. 

Right  nonlinear  innovations  and  Wold  decompositions  always  exist  (Theorem 
2.2).  Left  nonlinear  innovations  always  exist  (Proposition  2.8)  and  we  note 
that  a  left  nonlinear  Wold  decomposition  exists  whenever  a  left  Wold  decompo¬ 
sition  exists.  The  right  and  left  innovations  and  Wold  decompositions  have 
precisely  the  properties  required  to  solve  the  problem  of  predicting  m-steps 
ahead  based  on  past  observations,  and  they  correspond  to  regression  prediction 
and  best  prediction  in  the  usual  pth  order  moment  sense  (l<p<a)  respectively 
Thus  when  a  right  or  left  Wold  decomposition  exists,  the  m-step  linear  regres¬ 
sion  prediction  or  best  linear  prediction  has  a  fairly  simple  solution.  How¬ 
ever,  when  a  Wold  decomposition  does  not  exist,  then  the  prediction  problem 
becomes  difficult  indeed  as  is  illustrated  by  the  case  of  harmonizable  stable 
sequences  (cf.  [  1  J). 

In  Section  3,  an  independent  decomposition  is  introduced  and  spectral 
necessary  and  sufficient  conditions  are  given  for  its  existence.  Section  4 
consists  entirely  of  examples,  intended  to  illustrate  the  various  decomposi¬ 
tions  and  some  of  the  complexities  involved. 
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1 .  Orthogonality  and  Stable  Systems 


A  collection  of  random  variables  { X^ :  t  cTl  defined  on  (f),Z,P)  will  be  called 

Jointly  symmetric  a-stable  or  a  symmetric  a-stable  process  if  each  finite  real- 
linear  combination  XA.X  has  a  symmetric  stable  distribution  of  index  a.  We  ab- 


breviate  "symmetric  a-stable"  by  SaS.  If  X  is  SaS,  then  for  0  < p  < a,  we  have 

E  | X  |  p  <  «-,  so  that  a  SaS  process  {X^ }  is  a  pth  order  process,  i.e.  { X^  >  £  LP(ft,X,P) 

A  useful  tool  in  the  analysis  of  SaS  processes  is  the  so-called  spectral  represent 

ation  theorem.  The  version  we  will  need  here  says  that  if  {X^:  n  c A]  (where  A  is 

finite  or  denumerably  infinite)  is  a  SaS  process,  then  there  exist  functions 

i  f  :  n  €  A)  c  L,a[0,ll  such  that 
n  ~ 


-log  E  exp(i  \  \  X  )  =  ||  I  A  f  II* 
J=1  3  J=1  J 


Further,  if  fz(s):  sc  10,1]}  is  "  a-stable  motion,"  i.e.,  an  independent  incre¬ 
ments  SaS  process  with  -log  E  exp  itZ(s)  =  s|t|a,  then  the  process  {Y^}  defined  by 


Y  =  fj. f  (s)dZ(s) 
a  •'On 

is  stochastically  equivalent  to  (Xn } ,  and  we  say  that  {x^}  is  represented  by 
{f^}.  The  spectral  representation  was  first  expressed  in  this  form  by  Kuelbs 
[  7  J;  for  more  information  consult  [4  ]. 

Now  let  L  be  a  normed  linear  space,  with  norm  ||*||.  For  x,ye  L,  we  say 
that  x  is  (James)  orthogonal  to  y,  written  x  i  y,  if 

||  x  +  Ay  ||  *  ||x|| 


for  all  scalars  A.  For  subspaces  M  and  N  of  L,  we  say  MiN  if  min  for  all  mcM 
and  n  e  N.  If  L  is  in  fact  a  Hilbert  space,  this  defines  the  usual  "inner  product" 
orthogonality.  For  general  Banach  spaces,  however,  this  is  a  non-symmetric 
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notion,  i.e.  x  may  be  orthogonal  to  y,  but  not  vice  versa. 

th 

This  definition  makes  sense  for  random  variables  with  p  moments  in  that  we 

may  take  (L,  ||*||)  to  be  LP(fi)  with  the  usual  norm.  For  X  and  Y  in  LP(fi) ,  if  X 

is  orthoeonal  to  Y.  we  will  write  X  X  Y.  The  relation  l  is  well-defined  for 
6  P  P 

jointly  SaS  random  variables  as  long  as  1  ^ p  <a 

The  following  known  characterization  of  orthogonality  will  be  useful  for  us. 
For  a  proof,  consult  [  13  ;  Thm.  1.11,  p.  56  and  Lemma  1.14,  p.  92] 

Lemma  1.1.  Let  X  and.  Y  be  random  variables  with  moments ,  p  >1.  Then  X  l  Y 

p 

if  and  only  if  EX<P  ^Y  =  0. 

<q> 

Here,  we  use  the  convention  that  for  complex  z  and  real  q,  z  denotes 

|  |z|^  ^z.  (We  take  0  ^  =0.) 

A  point  evident  from  this  lemma  and  crucial  for  us  is  that  the  orthogonality 

relation  is  "linear"  in  the  second  argument,  but  not  in  the  first,  i.e.  Xx  Y 

P 

and  X  l  Z  implies  X  l  (aY  -FbZ)  for  all  a,b  —  but  we  may  have  X  X  Z  and  Y  x  Z 

p  p  p  p 

without  X  +  Y  X  Z . 

P 

The  next  lemma  is  somewhat  curious. 

Lemma  1.2.  Let  a>l  and  (x.Yl  be  jointly  SaS  represented  by  {f,gh  Then  for 
all  pc  (l,a), 

''n  -1  >  r  <a— 1  > 

EX  1  Y  =  Jf  g  dm 

E  |  X  |  P  /  |  f  | 01  dm 

(m  is  Lebesipue  measure  on  [0,1]  ) . 


I  Remark.  Note  that  the  right-hand  side  does  not  depend  on  p.  It  follows  from  this 

and  Lemma  1.1  that  for  such  X  and  Y,  X  x  Y  for  seme  p  c  (l,n)  if  and  only  if  X  i 

P  P 

for  all  such  p,  if  and  only  if  f  x^  g .  We  shall  henceforth  say  in  this  case  simply 


that  X  is  orthogonal  to  Y,  omitting  mention  of  p,  and  write  X  XY. 
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ifXo  _  i  |  a. 

Proof  of  Lemma  1.2.  Let  X^  by  SaS  with  Ee  =  e  .  Now, 

E  exp  1  it  (X  +  AY)  J  =  exp  [- 1|  f  +  Ag  ||^ 1 1 1 a] ,  which  shows  that  X  +  Ay  is  distributed  as 
||f  +  Ag||  X  .  Therefore, 

e|x  +  Ay  I  P  =  II  f  +  Ag  ||  P  E  |x0  I  P. 

Differentiating  this  expression  with  respect  to  A  and  putting  A  =  0,  we  obtain 
when  1  <  p  <  a  that 

E  X  <P-1>Y  =  E  |  XQ  I P  1 1  f  ||  P_0t/f  <a_1  >g  dm  =  E I X  |  P  | )  f  11”°^/ f <0t_ 1  >g  dm  , 
proving;  the  lemma.  1] 

It  follows  from  Lemma  1.2  that 

E(Y  |X)  =  — 1  ■&  — m  X  =  — - -  X 

/fff  dm  E|X|P 

where  the  first  equality  is  established  by  Ranter  [6].  This  combined  with 
lemma  1.1  show'- 

Corollary  1.3.  -r S  iS  {x,Y>  represented  bp  {f,g}  and  1  <p<a  we  have 

<n—  1  > 

FY  ^  V  , 

X  x  Y  -  — - -  X  =  Y  -  E(Y|X)  ; 

E  1X|  P 

and  the  ,*V  ? h.uiina  are  equivalent: 

Li)  X  x  Y  , 

(Li!  E(Y  j X)  =  0  , 

(Hi)  EX<P_1>Y  =  0  , 

(io)  j f  1  ^  g  dm  =  0. 


We  note  that  if  X  and  Y  are  independent  SiS  variables,  then  necessarily 
X  xY  and  Y  xX.  The  converse  is  not  true,  however,  since  Schilder  [l 2  ]  has 
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shown  that  X  and  Y  are  independent  if  and  only  if  their  representatives  f  and  g 
have  a.e.  disjoint  support  (i.e.  f*g  =  0  a.e.).  Clearly  there  exist  f  and  g  with 
Jf  l_^>g  dm = 0  yet  f*g  4  0  a.e.  In  fact,  orthogonality  implies  independence 
nn.lu  in  Caussian  systems,  in  the  following  sense. 

Proposition  1.4.  Let  1  <a<2,  and  let  L  be  a  closed  linear  space  of  SaS  random 
Viriahles  with  dim(L)  >1.  Suppose  that  whenever  X,Y  el  and  X  iY,  then  X  is  in - 
:e;<  ndent  of  Y .  Then  a  = 2,  i.e.  L  consists  of  mean-zero  Gaussian  random  varia¬ 
bles. 

Proof .  Choose  an  arbitrary  non-zero  X  £  L  and  let  1  <p  <a.  By  the  hypothesis 
d  im(L)  >  1  we  may  f  ind  Zf  L  such  that  Z  ^  XX  for  any  X  e  1R  .  Let  6  =  EX  15  ^  Z/E  jx  j  P. 
This  gives  that  EX  P  ^>(Z-8X)=0.  Since  Z  -  8x  4  0,  we  may  find  a  constant  b  so 
that  Y  =  b(Z-8X)  is  distributed  as  X.  Since  EX  P  ^  Y = 0,  Corollary  1.3  shows 
X  iY,  and  so  X  and  Y  are  independent  by  hypothesis.  This  implies  that  (X,Y)  is 
distributed  as  (Y,X),  and  hence  that 

E (X  +  Y)<P_1>(X  -  Y)  =  E(X  +  Y)<P_1>X  -  E(X  +  Y)<P_1>Y  =  0  . 

Hence  X+Y  l  X-Y,  and  again  this  means  that  X  +  Y  is  independent  of  X-Y. 

Now  let  c  be  such  that  <Ht)  =  E  exp(itX)  =  exp(-c|tl°)  =  E  exp(itY) .  Then 
by  independence  we  have  that  for  all  t, 

E  exp{i  [t  (X  +  Y)  +  t(X-Y)]}  =  E  exp{it(X  +  Y)}  •  E  exp{it(X-Y)} 

=  <^(t)  =  exp(-4c  1 1 1 °)  , 

and 

E  exp fi[t(X+Y)  +  t(X -"))}  =  E  exp{i2tX} 

=  <K2t)  =  exp(-2°c  1 1  |a)  . 

Therefore  2a  =  4  and  0t  =  2.  fj 


The  equivalences  of  Corollary  1.3  can  be  seen  in  a  broader  context.  Let 
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1  <  p  <  a,  and  let  (x^:  t  <■  T)  be  any  SaS  process  represented  by  { f  ^ ;  t  cT) 

(T  here  is  arbitrary) .  Fix  an  arbitrary  subset  S  of  T,  let  t  e  T\S,  and  def ine 

L(S)  -  spfx  :  s  i  S)  and  L'(S)  =  sp{f  :  s<s)  .  The  following  result 

LP(U)  S  L  " 

gives  necessarv  and  sufficient  conditions  for  the  conditional  expectation  to  be 
linear,  i.e.  to  belong  to  L(S) . 

Proposition  1.5.  The  following  are  equivalent: 

(i)  E(X  |X  :  s  e  S)  e  L(S)  . 
t  s 

( ii )  There  exists  X e  L(S)  such  that  L(S)  i  X  -  X  (in  which  case 

E(X  |X  :  sfS)  =  X). 

t  s 

(Hi)  There  exists  geL'(S)  such  that  L'(S)  f  -  g  (in  which  case 

E(X  lx  :  s  (  S)  is  represented  bu  g). 

t  s  ' 

P-oof .  Let  .Tq  be  the  spectral  representation  ma^  for  {x^l,  i.e.  Jp(X  )  -  f f . 

Use  the  same  argument  as  in  the  proof  of  Lemma  1.2  tc  see  that  for  any  t ^  c  T 

and  scalars  X., 

J 


"J  y« « -  iiiVt.'i « • 

j=l  J  J  L^(fl)  j  l 


LP(fi) 


where  XR  is  as  in  Lemma  1.2.  Putting  c  =  ||Xq||  ^  ,  this  shows  cJ^  extends  by 

linearity  and  continuity  to  an  isometry  cJ  of  L(S)  onto  L'(S).  Hence  (ii)  and 
(iii)  are  equivalent. 

We  show  (i)  and  (iii)  are  equivalent.  Let  Y  by  any  arbitrary  element  of 

L ( S ) ,  and  define  h  =  J(Y) .  (Or  equivalently,  let  h  be  arbitrary  in  L'(S)  and 
— 1  ^ 

define  J  =  J  (h).)  For  (u)  =  E  exp  [  i(uX^  +  Y)  1 ,  we  have 

Ct  ^ 

C  ( u )  =  exp[-||uft  +h|[^],  and  thus,  putting  X  =  E  (X  ^  t  X  ^ :  StS),  that 


*  «**  •*  '  ■  /*  .**  .  '  '  .  .*  .* 

•  *.  *.  •,  *.  '.  ‘.  ,  \  ’. 


E  eiYX  =  EXteiY  =  -iO'(O)  =  i  expf-|jh||^]/h  a  1'  dm. 

Now  for  arbitrary  X  t  L(S),  let  g  =  J(X).  (Again,  we  may  let  gi  L'(S)  and  define 
X  =  I  ^(g).)  Define  tjj(u)  =  E  exp  f  i(uX  +  Y)  | ,  and  note  that 
V(u)  =  exp[-!|ug+  h  11^1  ,  and 

Ee^X  =  -ity'(O)  =  iaexp[-||hjj^]  Jh  1  *  g  dm. 

This  gives 

Ee^X  -  X)  =  ictexp [- |lh  ||  |]|h  "*  1:>(ft  -  g)  dm. 

Since  both  X  and  X  are  measurable  with  respect  to  o(x(s):  s ■  s},  we  have  that 
X  =  X  if  and  only  if  EeiY(X  -  X)  =  0  for  all  Y  c  E(S)  (see,  e.g.  [  8  ]  or  1 1 0 ] ) . 
This  fact  and  lemma  1.1  applied  to  the-  last  equation  give  us  the  equivalence  of 
(i)  and  (iii),  proving  the  proposition.  H 

In  particular,  this  shows  how  the  linearity  of  regression  is  related  to 
orthogonality. 

Corollary  1.6.  '.'he  following  ai'e  c-.vdv  .ilent. 

(i)  E(X  |X  :  sf  S)  =  0. 

t  s 

(ii)  spfx  :  slS)  i  X  . 

1 

(Hi)  sp{f:stS}  l  f. 

s  a  t 


2 .  Orthogonal  Decomposition  of  Stable  Sequences 


Throughout  this  section  we  assume  1  <  ot  <  2  and  take  p  such  that  1  <  p  <  .  Also 

we  let  (x  :  -°°  <  n  <  °°l  be  a  SotS  sequence  on  (M  E,P)  .  We  define  the  linear  spaces 
n 

of  the  sequence: 

L  =  sp{X,  :  k  < n I 
n  k  LP(P) 


L  =  nL  , 
-°°  n  n 


and  the  corresponding  nonlinear  spaces: 


L  =  LH(Q,Z  P)  , 
n  n 


L  =  iiL 
n  n 


where  =  fix,  ,  k-  n’t.  Note  that  L  consists  of  SaS  random  variables,  while  1 
n  k’  n  n 

contains  much  more.  Note  also  that  since  for  every  X<  spix^:  -00  <  n  <  °°}  with 


representative  f  t  L  we  have,  as  in  the  proof  of  Lemma  1.2,  ||X 


T.P(«) 


=  C  ||f| 


for  some  constant  C  =  ||Xn||  depending  only  on  p  and  not  on  X,  the  choice  of 

P  0  LP(P) 

p  in  (1,  t)  throughout  the  following  is  immaterial. 

We  will  be  concerned  with  the  orthogonal  decomposition  of  these  spaces.  Our 
notation,  which  is  somewhat  non-standard,  is  as  follows.  For  a  Banach  space  M 

)  denotes  the  sub- 

'i  .,cc' 

space  {x,  +  .  .  .+  x  :  x  .  c  M  .  ,  H  j  <nt.  Also ,  M,  +  M  +  . . .  (or  I.  ,  M . )  is  def  ined 
1  n  j  j  ’  J  ’12  j=l  ] 


and  closed  spaces  M, ,M„ ,...,  the  symbol  M.  +  ...+  M  (or  X.  ,  M. 

12  1  n  j=l  j 


to  be  the  subspace  ,M..  Writing  M  =  M  ©...€>  M  (or  M  =  I?  .  ®  M.)  means 

n  j  =  l  j  b  1  n  j  =  l  -*•  j 


that  M  =  M,  +  .  .  .+  M  and  also  that 
1  n 

(M,  +. . .+  M, )  i  (M.  M  )  for  all  1  <  k  <  n  . 

1  k  k+1  n 


(2.1) 


Writing  M  =  M,  $...«  M  (or  M  =  I1?  ,  9  M.)  means  that  M  =  M,  +.  .  .+  M  and  that 


for  all  1  < k  <  n , 


(2.2 


(M  +. . .+  M  )  l  (M,  +. . .+  M.) 
n  k+1  k  1 


i.e.,  that  M  =  M  $. . .$  M  .  Thus  the  statements  M  =  M,  9  M„  and  M  =  M  $  M 
n  l  1^2  1  2 

OO  Cr.3 

are,  in  general,  distinct.  Writing  M  =  ^  M.  (respectively,  M  =  f  M.) 

J  J  J  J 

OO 

will  denote  that  M  =  Z^M  and  further  that  (2.1)  (respectively  (2.2))  holds 
for  all  n. 

OO 

If  M  =  Z  9  M.  and  we  pick  0  4  x.  eM.,  it  follows  that  {x . }  forms  a  basis 
3~1  J  j  j  j  J 

tor  its  closed  linear  span ,  i.e.  each  x  c  sp{x.:  3=1,2,...}  has  a  unique  norm- 

OO 

convergent  expansion  x  =  Z.  ,A.x.  for  some  scalars  A..  This  is  so  because  a 

3=1  J  J  3 

necessary  and  sufficient  condition  for  ix_. }  to  be  a  basis  for  its  closed  linear 
span  is  the  existence  of  K<®  such  that  for  all  n,  m<n,  and  scalars  6., 

II  ^j=i^jXj  II  -  k||  Zj_^8jXj  ||  (see.  e.g.  [  14]);  and,  because  of  orthogonality. 


11 1  Vi 


m  n 

||  l  6  x  +  l  B  x  || 

j=l  J  J  j=m+l  3  3 


m 


y  3.x. 

*-■  t  i 


3  =  1 


3  3 


The  same  argument  cannot  be  made  in  the  case  M  =  Z  9  M  . 

3  =  1  *  3 


Right  Innovations  and  Wold  Decomposition 

We  will  say  that  (X^l  has  right  innovations  if  for  each  n  there  is  a  sub¬ 
space  N  so  that  L  =  L  .  9  N  .  N  is  necessarily  of  dimension  one  or  zero 
n  n  n-i  ->  n  n 

(by  an  elementary  argument).  Similarly,  we  say  that  {X  }  has  right  non- linear 

n 

innovations  if  for  each  n  there  is  a  subspace  N  so  that  1=1  9  N  . 

n  n  n-1  ->  n 

We  say  that  (X  }  has  a  right  Wold  decomposition  if  there  are  subspaces  N 

n  n  > 

On 

_oo<n<oo,  so  that  for  each  n,  Ln  =  (Zk=Q  9  N^)  f  L_w,  Ln  l  for  all  m>n, 

OO  «  ^ 

and  further  each  Z  r  Z  •  N  .  has  an  I.  -convergent  expansion  Z  =  Z  W 

k=0  *■  n-k  °  r  k=0  n-k’ 

Wj  Nj ’  which  is  then  necessarily  unique.  In  this  case  it  is  easy  to  see  that 

we  can  write  X  =  Y  +  Z  ,  where 
n  n  n 


(i)  {Y  ;  and  {Z  }  are  jointly  SaS  processes. 


(ii)  {Y  }  c  L  (the  "remote  past")  and  (Y  }  l  [Z  }, 
n  _  n  n 


(iii)  there  exist  e  N.  and  a,  £  1  so  that  Z  =  1,  na,  f,  ,  . 

j  j  k,n  n  k=0  k,n  n-k 


In  the  case  that  X  is  stationary  and  not  completely  deterministic  (i.e.. 


L  ^  O,  we  may  choose  ||C.  ||  _ 

U  J  LP(D) 


=  1  and  claim  that  a.  is  independent  of 

k,n 


n,  i.e.  Z  is  a  moving  average  of  an  "orthonormal  sequence". 


Similarly,  we  can  define  right  non-linear  Wold  decomposition  by  requiring 


the  existence  of  N  so  that  L  =  (Z,  _©  N  )«L  L  i  N  for  m  >n,  and 

n  n  k=0  <-  n-k  *-  -00  n  m 


with  the  property  that  each  Z  e  Z^_q  f-  k  *ias  a  norm  convergent  expansion 


1=1,  _W  ,  ,  W,  (N.,  which  is  then  unique. 
k=0  n-k  j  j 


The  first  result,  Proposition  2.1,  is  the  key  ingredient  to  the  proof  that 
right  innovations,  linear  or  non-linear,  imply  the  corresponding  Wold  decompo¬ 
sition  (see  Theorems  2.2  and  2.3).  This  proposition  is  implicit  in  [  2 ]  and 
l  3];  we  include  a  proof  here  for  completeness. 


Proposition  2.1.  Suppose  that  M  is  a  closed  subspace  of  some  Lp  space,  p>l. 


and  that  there  exist  closed  subsvaces  M  and  0  of  M  with. 

-  n  n 


'•!  =  M  ®  0  9...e  0  for  each  n  2  1.  Then  M  =  (Z  ,  f  fli«  (n  II  )  and  each 

n  -*■  n  1  J  n=l  +  n  <-  n  n 

k  ••  1  ,  ®  0  has  a  umque  norm  convergent  expansion  k  =  E  ,o  .  o  t  0  . 

n=l  n  '  n=l  n  n  n 


Proof.  Define  M  =  nM  K  =  0  Q. . .9  0, ,  and  K  =  uK  .  We  first  show  that 
-  °°nn  n  n  ►  ->-  1  °°nn 

M  =  M  9  K  .  Clearly,  M  i  K  for  each  n,  and  by  continuity,  M  l  K  .  Now 

CO  ->CX>  y,°°n  ’  J  *',oooo 

for  x  •  M,  write  x  =  m  +  k  with  m  c-  M  ,  k  c  K  .  Since  m  ik  we  have  that 

nn  nn  nn  nn 

ll®n  II  *  limn  +  knH  =  HXH  and  Hknll  -  Hx  ~  mnH  -  2 1 1  x  H . 

The  sequences  mn  and  k^  ,  being  norm  bounded  in  a  reflexive  Banach  space, 

have  simultaneously  weakly  convergent  subsequences,  say  {m  }  and  {k  }  with 

n ,  n . 


2.4 


weak  limits  m  and  k  ,  respectively.  It  is  clear  that  x  =  rn  +  k  ,  and  that 

OO  OO  ’  r  J  <JU  00  » 

k  e  K  ,  proving  M  =  W  9  K 

CO  OO  *  r  °  00  00 

It  remains  to  show  that  each  element  k  <  has  a  unique  norm  convergent 

00 

expansion  k  =  X  ,  o  ,  o  e  U  .  For  each  n  we  can  write  k  =  m  +  k  uniquely 
K  n=l  n  n  n  n  n 

where  m  •  M  and  k  i  K  .  In  turn  we  may  write  k  =  o,  +...+  o  uniquely 
nnnn  nl  n  1 

with  o.  r  0 .  .  Define  the  operator  Q  :  K  -+  K  by  Q  k  =  k  .  It  is  easy  to 
jj  v  n^n  nn  1 

see  that  QnQ^  =  Also  by  orthogonality  we  have  that 


l!Qnk||  s  || k  -  Qnk||  +  || k ||  =  IjmJI  +  ||k||  <  Hm^  +  kj|  +  ||k||  =  2 1| k || 

so  that  (Q  1  is  a  bounded  sequence.  Clearly,  s-lim  Q  k  =  k  for  any  k  c  uK  . 

n  „  n  mm 

n-x» 

Hence,  by  continuity,  we  have  for  any  k  c  ^  that 

n  00 

k  =  s-lim  Q  k  =  s-lim  /  o.  =  )  o  .  I] 

n  i  1  ,  n 

n^°°  n->®  i=l  n=l 


Theorem  2.2.  {X  }  his  viiht  non- linear  innovations  and  a  ri;ht  non-linear 

-  n 

Wold  decomposition. 

Proof.  Note  that  for  each  n,  L  ,  =  { E ( X | Z  X  e  L  }.  Define 

-  n-1  n-1  n 

w  =  {X  -  E(x|E  XcL  }.  Clearly,  each  element  of  L  is  the  sum  of  an 

n  n-1  n  n 

element  of  L  ,  and  an  element  of  M  .  To  see  L  ,  l  M  ,  let  X  <:  L  ,  and 
n-1  n  n-1  n  n-1 

V  ‘  V  and  note  that  E(Y|X  ,)  =  0.  Hence, 
n  n-1 

EX<P_1>Y  =  EE(X<P_1>Y  [  )  =  EX<P_1>E(Y|Z  ,)  =  0  , 

n-1  1  n-1  ’ 


and  thus  (x^l  has  right  non-linear  innovations. 

To  see  that  (X^l  has  a  right  non-linear  Wold  decomposition,  fix  k  and  note 
that  by  the  argument  above 


L 


k 


I  <p  M 
k-l  •  k 


+  Vl’ 


k-2  ■  k_l 


*  \ 
®  Mk) 


Now  identify  L,  with  M  and  N.  ,  with  0  of  Proposition  2.1. 
y  k-n  n  k-n+1  n 

The  next  result  is  somewhat  more  interesting. 

Theorem  2.3.  The  folLowing  are  equivalent. 

(i)  {x^}  has  a  right  Wold  decomposition. 

(it)  (x  }  has  rrght  innovations. 

n 

(tii)  E(X  , lx  .  x  _ _ )  e  L  for  each  n,  i.e.  regressions  on  the 

n+1  n  n-1  n 

past  are  Linear. 


Proof .  The  "linear  version"  of  the  proof  of  the  second  statement  of  Theorem 
2.2  shows  that  if  (X^l  has  right  innovations  it  has  a  right  Wold  decomposition. 
The  converse  follows  by  definition,  so  (i)  and  (ii)  are  equivalent. 

We  show  the  equivalence  of  (ii)  and  (iii).  Take,  in  the  notation  of  Pro¬ 
position  1.5,  X  =  and  S  =  (n,  n-1,...).  Then  L(S)  =  L^,  and  by  that 

Proposition  we  have  that  (iii)  is  equivalent  to  the  existence  of  X  c  such 
that  i  X^+^  -  X.  The  latter,  clearly,  is  in  turn  equivalent  to  the 
existence  of  the  required  innovation  space  .  11 

Remark.  By  Theorem  2.2,  we  may  write  X  =  V  +  Z  where  V  .  L  and 
-  7  1  nnn  n  -  ■ 

Z  F,  ,  ®  N  .  If  { X  }  has  a  right  Wold  d  ecomposit  ion ,  we  have  X  =  Y  +7. 
n  k=0  +-  n-k  n  6  nnn 

as  in  the  comment  following  the  definition.  In  this  case,  we  must  have  /  =  Y 

n  n 

and  Z  =  Z  ,  since  L  cl  and  N,  =  (X  -  E(X  |  £,  , ) :  XeL,  } 

n  n’  _oo  -  _OT  k  1  k-1  k  - 

•'X  -  E  ( X  |  Z  ^  ^):  X  e  1.  }  =  and  the  decomposition  is  unique. 

Left  innovations  and  Wold  decomposition 

We  now  examine  Left  innovations  and  Wold  decompositions.  Their  definitions 
are  obtained  by  reversing  the  arrows  in  the  definitions  of  their  right  counter- 


2.6 


parts,  and  ignoring  the  requirement  L  i  (or  l  N^)  for  the  Wold  decompo- 

on 

sition  (as  N  i  L  follows  from  L  =  (X.  n®N  .  )  $  L  ) .  Also,  the  "basis 
m  n  n  k=0  *  n-k  ->  -oc 

OO 

property"  of  ®  ^  is  automatically  satisfied,  as  can  be  seen  from  the 

argument  following  the  definitions  of  ®  and 

As  conditional  expectation  is  an  appropriate  notion  for  the  study  of  right 
orthogonality,  the  metric  projection  in  is  an  appropriate  notion  for  the 
study  of  left  orthogonality.  For  completeness  we  include  the  needed  definitions 
and  preliminary  results  here  in  a  compact,  self-contained  way  (see  l  5  ,  9  ,  13]). 

Let  ((.,||*||)  be  a  Banach  space,  and  M  a  closed  subspace  of  L.  For  x  t  L, 
an  element  m  €  M  is  called  a  best  approximation  to  x  in  M  if  ||x  -  m  ||  <  1 1 x  —  rr 

X  X 

for  all  x  e  M.  If  L  is  reflexive  and  strictly  convex  (as  we  henceforth  assume 

throughout)  m  exists  and  is  unique  (see  [13]).  In  this  case  we  define  P  x  =  m 
x  M  x 

and  call  Pw  the  metric  projection  onto  M.  Pw  is  continuous,  bounded,  and  idem- 
potent,  but  not  in  general  linear.  In  fact,  if  is  a  linear  operator  for  all 
closed  subspaces  M  of  L,  L  must  be  isometrically  isomorphic  to  a  Hilbert  space 
(see  [13]). 

The  relation  between  orthogonality  and  metric  projection  is  illustrated  by 
the  following  two  standard  results. 

Proposition  2.4.  Let  Q:  L  -►  M  he  an  operator  (not  necessarily  linear).  Then 
Q  =  P,,  if  and  only  if  (I  -  Q)1  i  H. 

Proof .  Q  =  PM  if  and  only  if  ||x  -  Qxj|  <  ||x  -  mj|  for  all  meM  and  x  e  L,  if 
and  only  if  j|x  -  Qx  ||  <  ||x  -  Qx  +  m||  for  all  meM  and  x  e  L,  if  and  only  if 
(I  -  Q)L  i  M.  U 

Proposition  2.5.  x  i  M  tf  and  only  tf  P^x  =  0. 

Proof .  x  l  M  if  and  only  if  ||x  -  m||  >  |jx||  =  ||x  -  o||  for  all  meM,  if  and 
only  if  P  x  =  0. 


n 
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Although  PM  is  not  a  linear  operator  in  general,  the  following  known 


"quasi-linearity"  properties  are  true  and  will  be  needed  for  the  proof  of 


Theorem  2.10. 


’roposition  2.6.  P,,(<x)  =  «P  x  for  Sinlam  a  in< 1  x  r  L.  A  ln.>,  r’  (x  +  m) 

- - - -  M  M  M 


P^x  +  P^m  for  all  x  f  L  and  m  t  M. 


Proof .  The  homogeneity  is  obvious.  Also,  for  fixed  x  c  1,  m  e  M, 


(x  +  m)  -  (PMx  +  P^m) 


!  x  -  P  x  [|  i  [ ( x  +  m  -  m ' 


for  all  m'  f.  M,  showing  P^(x  +  m)  =  P^x  +  P,^m. 


Proposition  2.7.  If  M  has  codimension  one  in  L,  then  P^  is  a  linear  operator. 


Proof .  We  show  additivity;  the  homogeneity  follows  from  Proposition  2.6.  Let 


z,.  r  L\M  be  non-zero.  Then  for  x,  ,x.  t  L  there  are  unique  m.  i.  M  and  scalars 
()  12  j 


a.  such  that  x.  =  m.  +  a.z,,.  Then  by  Proposition  2.6, 
J  J  J  J  0  1 


PM<X1  +  x2> 


PM^ml  +  m2^  +  ^31  +  a2^Z0^ 


=  mx  +  ™2  +  +  a2)PMZ0 


=  PM(ml  +  alZ0)  +  PM(m2  +  a2Z0} 


=  P.  x,  +  P 


MX1  +  PMX2  • 


We  now  apply  these  facts  to  our  situation.  Call  L  =  L  =  sp{x  :  -°°  <  n  <  °°} 

+°°  v  n  n 

LP(f2) 

1  < p  <  a.  Since  is  reflexive,  so  is  L.  Denote  by  P^  the  metric  projection  of 


L  onto  L  .  It  turns  out  that  everu  SuS  sequence  has  left  innovations: 
n 


Proposition  2.8.  {x^}  ^as  left  innovations ,  both,  linear  and.  non-linear. 


Proof.  Define  N  =  (I  -  P  , )L  .  By  Proposition  2.4,  N  l  L  and  since 

-  n  n-1  n  y  r  *  n  n-1  ’ 

P  , L  =  L  .  we  have  L  =  L  .  +  N  .  The  proof  for  left  non-linear  innovations 
n-l  n  n-i  n  n-1  n 


is  identical. 


>  w  •  A  .  •  -  *  •  *  * 


Vvl 


Thus  no  conditions  are  needed  to  split  off  a  "left  orthogonal"  innovation 
space.  But,  unlike  the  case  of  right  innovations,  this  is  not  enough  to  produce 
a  left  Wold  decomposition.  The  problem  lies  in  the  impossibility  of  developing 


an  argument  like  that  of  Theorem  2.2,  as  the  following  example  shows. 

Example  2.9.  There  exist  one-dimensional  SaS  subspaces  M^,  M^,  such  that 
M  J-  for  all  j  4  k,  yet  is  not  orthogonal  to  M^;  hence 

(M3  f  M2)  f  M  1  M3  f  M2  f  Mr 


Proof.  Let  l<a<2  and  define  the  functions 


fi  =  'a-Wc-V 


f  =  1  +  2*1  -1  -  2*1 

2  A  B  C  D  ’ 


and 


3  10,1  |  , 

may  be  easily  checked  that 


where  A  =  [0,'i),  B  =  |V,'i),C  =  |l2,  H ),  and  D  =  f  H  ,  1  I .  It 


and 


/f.  a  ^  f.  dm  =  0  forj^k, 

J  k 

f(fl  +  f2)<^"1>f 3  dm  =  k(20l“1  +  1  -  3a_1)  >  0  . 


By  Corollary  1.3  this  implies  that 
have  the  advertised  properties. 


the  SuS  subspaces  =  {X/^f  (s)dZ(s) : 


X  r  1R  } 


There  is  still,  however,  a  nice  characterization,  in  terms  of  the  metric 
projections  P  ,  of  those  processes  having  a  left  Wold  decomposition. 

Theorem  2.10.  The  following  are  equivalent. 

(i)  (x  }  hart  a  left  Wold  decomposition. 

n 

(ii)  The  metric  projection  operators  P  :  L  -*■  L  are  linear. 

n  +°°  n 
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( Hi) 

The  operators  P^ 

cormra  te . 

(iv) 

Deno ti no  bu  P 

the  restriction  of  P  tv  L  ,  we  have  that  for  all 

n,m 

n  m 

At 

n,n+l  n+l,n+2  *"  n+k-l,n+k  n,n+k 

I’roof .  We  show  (iv)  =>(ii)  =>  (i)  (iv)  and  (ii)«>(iii). 

Assume  (iv)  holds.  By  Proposition  2.7,  each  operator  P^+^  n+£+i  li-near» 
implying  each  is  linear.  P^,  being  linear  on  each  is  by  continuity 

linear  on  all  of  L  ,  giving  (ii). 

Assume  (ii) .  Define  N  =(I-P  ,,)L  ,  and  let  Z  e  N  .  Then  Z  1  L  .by 

n  n-1  n’  n  n  n  n-1 

Proposition  2.4  and  thus  Z  l  L  „  for  £  s  1.  By  Proposition  2.5,  P  =  0. 

n  n— t  r  n— t  n 

The  linearity  of  P  shows  P  ,(Z  +  7  ,+...+  Z  , ,,)  =  0,  giving  us  by  Proposi- 

n  n-k  n  n-1  n-k+1  °  ° 

tion  2.5  that  N  +  N  ,+...+  N  ,  ,  l  L  ,  ,  and  hence  that 
n  n-1  n-k+1  n-k’ 

k-1 

L  -  O-n  „  N  ,,)«!.  ,  .  We  now  note  that  Proposition  2.1  and  its  proof  are 

valid  with  all  arrows  and  orthogonalities  reversed,  provided  we  change  the  esti¬ 
mates  on  m  and  k  to  read  ||k  I!  <  llm  +  k  ||  =  ||x  ||  and  ||m  II  <  ||x  -  k  ||  '  2  ||x  || 
n  n  n  n  n 1  1  n 1  1  n 

(Also,  we  may  ignore  the  proof  of  the  basis  property  of  I  ®  0^  by  our  remarks 
following  the  definition  of  left  Wold  decomposition.)  Applying  this  version  of 
Proposition  2.1,  then,  we  have  that  ( i 1  holds. 

Assume  ( i) .  Then  we  may  write  for  all  n  and  £  £  1, 

Ln+f  =  Nn+£  ?  Nn+f-l  Nn+1  *  V  ThiS  means  that  writin8  Y  e  Ln+f  (uni(luely) 

as  Y  =  Z  »+...+  Z  +  Y  with  Z.  <_  N.  and  Y  e  L  ,  we  have  P  «( Y)  =  Y  . 

n+e  n+1  n  j  j  n  n*  n,n+£  n 

Then 


P  .  i  •  •  -p  .i  ,  ^(Z  +  •  .  •+  Z  +Y  )  =  P  _  ...P  .  „  .  (Z  +  .  .  ,+Z  . .  +  Y 

n,n+l  n+k~l,n+k  n+k  n+1  n  n,n+l  n+k-2 ,n+k-l  n+k-1  n+1 


=  P  (Z  +  Y  ) 

n,n+l  n+1  n 


=  Y 


=  p  .  (Z  .  +...+  Z  +  Y  ). 
n,n+k  n+k  n+1  n 


Thus ,  ( iv)  holds. 


We  now  show  (ii)  +^(iii).  Assuming  first  that  (ii)  holds,  we  note  that 


for  arbitrary  W  e  L+oo  and  m^n. 


PPW  =  P(W-(W-PW))  =  PW-P(W-PW)  =  PW  =  PPW 

mnm  n  mmn  m  nm 


since  P  (W  -  P  W)  =  0  by  Propositions  2.4  and  2  5.  Hence  (ii)  implies  (iii)  . 
m  n 

Conversely,  assume  (iii)  holds.  We  show  by  induction  on  k  that  P^  is  linear  on 

each  L  ,  ,  whence  it  is  linear  pn  L,„  by  continuity.  P  is  homogeneous  by 

Proposition  2.6;  we  show  additivity.  Clearly,  P^  is  additive  on  .  Assume  it 

is  additive  on  L  ...  Let  W, ,W„  be  arbitrary  in  L  ,  and  define 
n+k-1  1’  2  J  n+k’ 

Y .  =  P  , ,  ,  W .  and  Z .  =  W.  -  Y . .  Note  Z .  l  L  . .  By  Proposition  2 .7 ,  P  , ,  , 
j  n+k-1  j  J  J  J  J  n+k-1  3  r  *  n+k-1 

is  a  linear  operator  on  L  and  this  coupled  with  (iii)  and  our  induction 
assumption  gives 


P  (W.  +  W„) 
n  i  l 


■  P„Wl(Vl  +  Y2  +  Z1  +  Z2> 


*  Pn(Yl  +  V 


P  V,  +  P  Y, 
n  1  n  2 


'  P„P„+k-l(Yl  +  V  +  ',Vh(Y!  +  Z2> 


=  P  W.  +  P  w„ 
n  1  n  2 


Thus  (iii)  implies  (ii) .  The  proof  is  complete.  D 

Remark.  The  observant  reader  will  have  noticed  that  we  make  no  use  whatsoever 
of  the  SotS  property  of  (x^l  in  Proposition  2.8  and  Theorem  2.10.  Thus  these 

t  tl 

results  are  true  for  any  p  order  process  {X^}  (i.e.  E |  | ^  <  00  for  all  n)  with 

P>1.  Of  course,  the  definitions  of  innovation  and  Wold  decomposition  in  this 
case  are  with  respect  to  the  LP  orthogonality  1^. 

We  do  not  have  a  characterization  of  {x  1  for  which  a  left  non-linear  Wold 

n 

decomposition  exists.  The  method  of  proof  of  Theorem  2.10  will  not  work  to 


2.11 


prove  a  non-linear  version  of  that  theorem,  as  it  uses  the  property  that  is 
codimension  one  in  L  However,  the  non-linear  analog  of  the  proof  that  (ii) 

implies  (i)  is  valid,  so  that  linearity  of  the  metric  projections  P  :  L  >  L 

n  +“  n 

implies  that  {x^}  has  a  left  non-linear  Wold  decomposition. 


Innovations:  Right  and  left,  nonlinear  and  linear 

It  is  of  interest  to  compare  the  various  types  of  innovations  introduced 

earlier,  which  unfold  the  information  of  a  Sots  sequence  ix  ). 

‘  n 

The  right  nonlinear  innovations  { 7^ }  are  given  by  the  residuals  of  the 
regression  of  X^  on  the  past  X^  , 

7r  =  X  -  E(X  |X 
n  n  n  n-1 

The  right  (linear)  innovations  {l^}  exist  precisely  when  these  regressions  are 

linear  (Theorem  2.3)  and  then  eq>al  the  right  nonlinear  innovations,  lr  =  Ir. 

n  n 

l  % 

The  nonlinear  left  innovations  {7  }  and  the  (linear)  left  innovations  {]  } 

n  n 

are  given  by  the  nonlinear  and  the  linear  prediction  errors  of  X^  from  the  past 


n-1’--' 


7  =  X  -  NL(X  X  .,...), 

n  n  n  n-1’  ’ 


I  =  X  -  L(X  X  .,...), 
n  n  n  n-1 


where  NL(X  |x  .,...)  is  the  "best"  nonlinear  and  L(X  lx  ,,...)  is  the  "best" 
n  n-i  n  n-1 

linear  predictor  of  X^  from  the  past  xn_j » • • • ,  i-e.,  the  element  of  the  non¬ 
linear  span  of  the  past  L  and  cf  the  linear  span  of  the  past  L  ,  which  is 

n  n 

nearest  to  X  in  L  -norm  (l<p<a). 
n  p 

l  l 

The  nonlinear  and  linear  left  innovations  coincide,  I  =  7  ,  if  and  only 

n  n  7 

if  the  best  nonlinear  and  linear  predictors  of  X^  from  the  past  X  coincide. 


2.12 


i.e.  if  and  only  if  the  metric  projection  of  X^  onto  ^  coincides  with  its 
metric  projection  onto  ^ ,  if  and  only  if  there  is  a  Y^  e  ljn_^  such  that 


E(X  -  Y  )<P_1>Z  =  0  for  all  Z  r  L  , 
n  n  n-x 


or  equivalently 


: { (x  -  y  )<p  1>|xn  o  , 

n  n  n-1 


l  ,1. 

(in  which  case  of  course  Y  -  I  *„)• 

n  n  n 


r  ^ 

The  nonlinear  left  and  right  innovations  coincide,  1^  =  1  if  and  only 


if  the  regression  predictors  from  the  past  coincide  with  the  best  nonlinear  pre¬ 
dictors  from  the  past,  £(X  |x  =  NL(Xn |Xn_1 , . . .) ,  if  and  only  if 


E{[X  -  E(X  | X  1,...)J<P  X>|X  =  0  . 

n  n  n-1  n-i 

This  condition  is  a  form  of  weak  conditional  symmetry,  and  is  clearly  satisfied 

if  the  conditional  law  of  X  given  X  ,  , . . .  is  symmetric  (since  it  will  then  be 

n  n-i 

necessarily  symmetric  about  its  conditional  mean  E(X^  |x^ . 

The  right  linear  innovations  exist  and  equal  the  left  linear  innovations, 

r  l 

I  =  I  if  and  only  if  the  regression  predictors  from  the  past  coincide  with 
n  n 

the  best  linear  predictors  from  the  past,  EfX^ | X^_^ , . . . )  =  L(X^ | Xr_^ , . . . ) ,  if 

and  only  if  E(X  |X  is  linear  and 

J  n  n-1 

E { [X  -  E(X  lx  , , . . .) ]<P_1>X.  }  =  0  for  all  k  <  n. 
n  n '  n-1  k 

This  is  weaker  than  the  previous  conditional  symmetry  condition  and  is  likewise 

satisfied  whenever  the  conditional  law  of  X  given  X  , . . .  is  symmetric.  Thus 

n  n-i 

symmetry  of  the  conditional  laws  and  linearity  of  the  regressions  implies  that 
all  types  of  innovations  coincide. 


So  far  we  have  limited  the  discussion  to  one-step  ahead  prediction. 

But  the  Wold  decompositions  and  innovations  introduced  here  are  precisely 
tailored  to  handle  the  general  m-step  ahead  prediction;  and  indeed  any  esti¬ 
mation  problem  based  on  observations  of  the  past  of  X.  To  simplify  the  no¬ 
tation  we  will  write  the  expression  of  the  m-step  predictors  and  their  errors 
in  terms  of  innovations  only  in  the  stationary  case.  Let 

OO 

X  =  Vr  +  l  a^Hr  . 
n  n  ,  n  k  n-k 
k=0 


be  the  right  nonlinear  Wold  decomposition  of  X,  which  always  exists.  Then 
Tr=  r 


a^  r.  ,  and  thus  it  can  be  written  in  the  form 
n  On’ 


^  l 

n  k=0 


-  f  . 

r  n-k 
l0 


Tt  then  follows  (as  in  the  proof  of  Theorem  2.2)  that  the  m-steps  ahead 
(m  > 1)  regression  predictor  is 


E(X  X  ...) 
n  n-m 


oo  a 

Vr  +  l  - 
n  . 

k=m  a 


n-k 


and  the  regression  prediction  error  is 


X 

n 


-  E(X  X 

n  n-m 


m-1  a, 

■>-  l  -7 

k-0  a0 


I 


r 

n-k 


If  a  linear  right  Wold  decomposition  exists  (cf.  Theorem  2.3),  then  one 
simply  replaces  V  by  Y  and  1  by  I . 

Now  assume  a  left  linear  Wold  decomposition  exists  (cf.  Theorem  2.10). 


Then  we  obtain  likewise 


3 .  Independent  Decomposition  of  Stable  Sequences 


As  we  observed  following  Corollary  1.3,  independence  implies  two-sided  ortho¬ 
gonality  for  SuS  random  variables,  but  not  conversely.  Thus  we  should  not,  in 
general,  expect  as  in  the  Gaussian  case  that  the  innovation  subspaces  in  a  Wold 
decomposition  are  independent.  In  this  section,  we  study  those  processes  for 
which  this  is  the  case. 

Using  the  notation  of  Section  2,  we  say  that  a  SaS  sequence  {X^}  has  inde- 

:  client  innovations  if  for  each  n  we  can  find  a  subspace  N  so  that  L  =L  ,  +  N  , 

r  n  n  n-1  n 

with  L  ,  and  N  independent.  To  symbolize  this  we  write  L  =L  ,  .  We  say 

n-1  n  r  J  n  n-1  n 

that  {x^}  has  an  independent  Wold  decomposition  if  there  exist  subspaces  {v  }  so 

CO  . 

that  for  each  n  L  =  I,  „N  ,  +L  where  iL  ,N,  :  keZ)  are  mutually  independent 
n  k=0  n-k  -°°  k  J  K 

00  “  -  r  i 

(in  symbols,  L  =  (Z  .)  $  L  ).  If  tX  ;  has  an  independent  Wold  decomposition 

then  clearly  it  has  both  right  and  left  Wold  decompositions  and  all  three  coincide 
The  independent  Wold  decomposition  for  stochastic  processes  with  infinite 
variance  was  studied  by  Urbanik  [16,17,18 1  for  strictly  stationary  processes 
"admitting  prediction",  and  by  Thu  [15]  for  random  fields.  Here  we  give  spectral 
necessary  and  sufficient  conditions  for  the  existence  of  such  a  decomposition  for 
S  aS  sequences. 


Theorem  3.1.  Let  1  <a<2  and  let  {x  }  be  a  SaS  sequence,  represented  bu 

{f^}.  The  following  are  equivalent. 

(i)  {X^}  has  independent  innovations. 

(ii)  {x^}  nn  independent  Wold  decomposition. 

(Hi)  For  all  n,  f  =  g  +  h  ,  where  g  c  sp{f,  :  k<n-l}  and 

n  °n  n  n  r  k  a 

L< 

f  •  h  =0  a.e.  for  k<n-l. 
k  n  J 

oiv)  For  ail  n,  f  =  7  ..  a,  ^  ,  where  •  n  ap{f,  :  k<m), 

n  k=0  k,n  n-k  n  n  m  k 


spif^:  k*cn}  =  nspff.^:  k<m}  +  sp{(f^:  k^n},  =  ^  ‘ r 


all  k,  £,  and 


ipp  =  0  a.e.  for  all  k  1 


i. 


Proof .  We  show  first  that  (i)  is  equivalent  to  (ii) .  Assume  (i)  holds,  and 
observe  that  for  fixed  n  we  may  write 


L  =  L  ,  9  N 
n  n-1  n 


=  L  0  ©  N  ,  ©  N 
n-2  n-1  n 


=  L  .  ,  ©  N  ,©...©  N  . 
n-k-1  n-k  n 

Choosing  l<p<a,  and  applying  Proposition  2.1  (remembering  that  independence 

OO 

implies  orthogonality),  we  get  that  =  (E^.q  f  \  ?  L  m  and  that  each 

CO 

Z  e  E^_q  ^  Nn_k  ^aS  t*le  aPProPr:*-ate  unique  expansion.  Since  the  spaces  L^  ^ 

N  ^, ...,  are  mutually  independent  by  the  construction  above,  the  mutual  in¬ 
dependence  of  {L  ^,  N  :  keZ}  follows.  So  (i)  implies  (ii).  Also,  (ii)  implies 
(i)  by  definition. 

We  now  deal  with  the  spectral  conditions  (iii)  and  (iv).  Recall  Schilder's 
result  that  SaS  variables  are  independent  if  and  only  if  their  spectral  representa¬ 
tions  have  almost  disjoint  support. 


Assume  (i).  We  may  then  write  X  =  Y  +  Z  with  Y  e L  ,  ,  and  Z  independent 

n  n  n  n  n-1  n  v 

of  i .  Denoting  by  (g^.h^}  the  representatives  of  {Y^.Z^},  we  see  (iii)  holds. 

Conversely  if  (iii)  holds,  we  let  Z  be  the  random  variable  in  L  which  is 

n  n 

represented  by  h  ,  and  let  N  =  sp{Z  )  .  N  is  independent  of  L  ,  since  f  *h  =0 
n’  nrnn  r  n-1  k  n 

for  k<n-l.  It  is  clear  that  L  =  L  ,+N,so(i)  holds.  This  shows  ( i)  is 

n  n-1  n’ 

equivalent  to  (iii). 

Assume  (ii).  If  dim(N.)  4  0,  choose  a  non-zero  W.  eN..  Otherwise,  let  W.  =0. 

j  J  3  3 

Let  }  be  the  representatives  of  {w^l.  By  hypothesis,  X^  has  an  independent 

OO 

expansion  X  =  Y  +  £ ,  a.  W  ,  where  Y  eL  .  Letting  {tjO  represent  (Y.},  we 

n  n  k=0  k,n  n-k  n  -°°  J  j 

have  f  =  to  +  L  a,  d>  ,  ,  with  ip  e  nsp{f  :  k<m}.  The  relation 
n  n  k=0  k,n  n-k  n  m  k 


3.3 


«_  OO  _ 

q  ®  ^n-k  translates  in  representation  space  to  the  remaining  state¬ 
ments  in  (iv).  Hence  (ii)  implies  (iv).  That  (iv)  implies  (ii)  is  easily  seen, 

A  00  A 

since  (iv)  implies  (iii)  with  g  =  ip  +  Z,  ,  a,  0  ,  and  h  =  a.  0  .  There- 

°n  n  k=l  k,n  n-k  n  0,n  n 

fore  (ii)  is  equivalent  to  (iv)  and  the  theorem  is  proved.  □ 


In  the  stationary  case,  this  result  takes  on  the  following  form,  where  we 
assume  for  simplicity  that  {x^}  is  completely  non-deterministic ,  i.e.  L  m  =  (0). 

Theorem  3.2.  Let  1  < a  < 2,  and  let  {x^}  be  a  SaS  sequence  represented  by  {f^}. 
Then  {x^}  is  stationary ,  completely  non-deterministic,  and  has  an  independent 

Wold  decomposition  if  and  only  if  (iv)  of  Theorem  3.1  holds  with  ip  =  0,  and  with 

n 

a^  ^  and  1 1 0  J  j  ^  independent  of  n. 

Proof .  Assume  first  that  {x^}  is  stationary,  completely  non-deterministic,  and 
has  an  independent  Wold  decomposition.  Let  S  be  the  canonical  shift  of  {X^}, 
i.e.  S  is  the  isometric  linear  extension  of  the  map  SX  =  X  ,  on  LP(ft,£,P). 
Since  S  preserves  joint  distributions 


L  .  9  N  =  L  =  SL  ,  =  S(L  ©  N  )  =  SL  ^  SN 

n-1  n  n  n+1  n  n+1  n  n+1 


=  L  •  SN 
n-1  n+1 


This  implies  SN  -  =  N  .  Choosing  a  non-zero  W.eN.  and  defining  W,  =  S 

n+1  n  u  0  k  0 

we  see  that  {w.}  is  an  i.i.d.  sequence  with  e N^.  By  our  assumption,  then. 


we 


may  find  a,  so  that  X  =  Z,  a,  W  ,  for  each  n.  Note  that 
k,n  n  k=0  k,n  n-k 


l  a,  W  =  X  =  SX 
, un  k,n  n-k  n  n+1 

k=0  ’ 


7  a,  ,,SW  ,  , 

.  ' _  k,n+l  n+l-k 
k=0 


y  ai  ,W  ,  , 

k=0  k*a+1  n-k 


whence  a,  =  a.  does  not  depend  on  n. 
k  k,n  r 

Letting  {0.}  be  the  representatives  of  {W.},  we  have  that  f  a,  0 

J  j  n  k=0  k  n-k 


3. 


That  l!$jlla  is  constant  in  j  follows  from  the  fact  that  (w^ }  is  identically 

distributed,  and  that  4>.*4>,  =  0  a.e.  for  k  ^  j  follows  from  the  independence  of 

1  K. 

{W.}.  sp{f,:  k^n}  =  sp{4>,:  k<n}  since  L  =  sp{W  :  k<n},  and  the  first  impli- 

J  K  K  n  K. 

cation  is  proved. 

For  the  reverse  implication,  let  W.  eL.  be  the  SaS  random  variable  repre- 

3  3 

oo 

sented  by  . ,  and  let  N.  =  sp{w.}.  Clearly,  {w . }  is  i.i.d.  and  X  =  E  a,  W  , 
J  j ’  Jj  1  n  k=0  k  n-k 

This  moving  average  is  stationary  and  completely  non-deterministic . 

L  =  sp{w  :  k<n}  since  sp{f  :  k^n}  =  sp{ <}>  :  k<n},  proving  the  theorem.  □ 

n  K.  K  K. 


We  present  here  some  examples  of  SaS  processes  having  or  not  having 
various  of  the  decompositions  discussed  in  previous  sections.  They  are  in¬ 
tended  to  illustrate  the  theorems  we  have  proved  (although  they  do  not  ex¬ 
haustively  do  so),  and  more  importantly,  to  provide  some  feeling  for  what 
is  and  what  is  not  possible  regarding  these  decompositions.  We  should  note 
at  the  outset  that  in  the  Gaussian  case  a=2,  all  aforementioned  decomposi¬ 
tions  exist  and  coincide;  and  the  situation  for  a  <2  should  be  compared 
with  this. 

Example  4.1.  Certain  autoregressive  and  moving  average  SaS  processes  have 

Wold  decompositions.  Specifically,  let  {£^}  be  a  sequence  of  i.i.d.  SaS 

variables.  If  for  all  n,  {x  }  satisfies  either 

’  n 

(i)  X  ,  =  L  X  ,  +  £  .,  with  £  independent  of  L  , ,  or 
n+1  k=0  k  n-k  n+1  n  r  n-1* 

(ii)  X  =  if  y,  £  ,  with  £  eL  , 

n  k=0  k  n-k  n  n 

then  {X^}  has  an  independent  Wold  decomposition. 

Proof .  In  the  case  (i) ,  it  is  clear  that  (x^)  has  independent  innovations, 

and  so  by  Theorem  3.1  has  an  independent  Wold  decomposition.  The  existence 

of  the  decomposition  in  case  (ii)  follows  by  definition  (with  = spiC^}) . 

Of  course,  left,  right,  or  two-sided  decompositions  exist  for  such  {X  } 

n 

when  the  appropriate  hypotheses  of  left,  right,  or  two-sided  orthogonality 

of  {£  }  are  assumed.  □ 

n 

If  i  L^,  however,  a  moving  average  as  in  4.1(ii)  may  not  have  a  Wold 
decomposition,  as  the  following  example  shows. 

Example  4.2.  There  exists  a  stationary  SaS  moving  average  that  has  a  left 
Wold  decomposition,  >et  does  not  have  a  right  or  independent  Wold  decomposition 
Specifically,  let  {£}_«,  be  an  i.i.d.  sequence  of  SaS  random  variables, 


4.2 


1  •  x  <  2.  Set  S  =  5  -  25  ,.  Then  (X  }  does  not  have  a  right  (linear)  Wold 

n  n  n-1  n 

decomposition,  yet  does  have  a  left  (linear)  Wold  decomposition. 

Proof.  To  show  (X  }  does  not  have  a  right  Wold  decomposition,  we  proceed  as 
-  n 

follows.  Assume  that  {X  }  does  have  a  right  Wold  decomposition,  in  which 

n 

case  we  have  E(X  ,,|X  ,X  ,,...)  e  L  by  Theorem  2.3.  We  show  that  (X,  :  k  r  n) 
n+1 1  n  n-1  n  k 

.  00 

forms  a  basis  for  its  span,  whereby  we  may  write  E(X  jJX  ,Xn_^, . .  .)  =  ^-O^k^n- 

for  some  {A^}.  We  then  determine,  using  orthogonality,  the  only  possible  choice 

for  the  sequence  {A^},  and  show  that  all  necessary  orthogonality  relations  do  not 

hold  with  this  choice,  completing  the  first  half  of  the  proof. 

To  show  that  (x^:  kin]  forms  a  basis  for  its  span,  it  suffices  to  show 

there  exists  K  such  that 

M  N 

l  B.X  .  ||  <  K ||  l  B.X  . 

u  i  1  '  r*  I  l  L.  1  n  _ 


j=o  J  p 


•:0  3  n-j  P 


for  all  Bj  and  all  M  <  N.  Recall  that  for  any  1  <  p  <  ot  there  is  a  constant 

c=c(p,a)  such  that  for  all  SaS  variables  X  with  representative  f, 

||x  ||  =  c  1 1  f  |l  .  Note  also  that  we  may  represent  (5  }  by  (lr  .,}  on  La(IR) . 

1  'p  "a  1  n  }  [n,n+l] 


Hence 


||  l  B.X  .  ||a  =  ||  l  6.(5  .  -  2?  .  ,)  || 

J  n-j  "p  "  j  n-j  n-j-1  11 


=  c 


L 

L5  +  I  (B.  -2B.  ,)5  .  -  2  BE  T  ,  ||a 

On  j=i  J  J-1  n_J  L  n-L-1  p 

[|B0|a  +  I  |H.  -2B  +  |2BL|a] 

j  =  l  J  J 


-  C“‘SL- 

^N  -a 

It  thus  suffices  to  find  K  such  that  —  2  K  .  We  claim  that  K=2  will 


satisfy  this  requirement.  To  see  this,  call  3=  |  |  ~  -  |  3 .  -28.  |”,  and 

a  u  j  1  J  J-t 


V 5 —  .  Then 

k 


3+  l  IB  -28  T  +  |26 J01 

1  J  J  W 


8  +  28, 


5  min  (1, 


l  |  8.  -23.  .  !“  +  1 26  | 
ii  J  J"1  N 


lin  (1,  I  Iy.  1-Y,/2|a+  hN_M|a)  • 
j=l 


Putting  n  =  N  -  M,  we  have 


nVl-V2|"+  lvN.M|1''  ll-V*!”*  lYj -Yj/2|“  +...+ 


IVi-Vil“*lYnl“. 


We  may  verify  this  is  S  2  as  follows.  If  not,  then  all  terms  must  be 
less  than  2  a,  i.e.  |l  —  y ^ / 2 |  <  |y^  —  Y2 / 2 ]  <  h,  etc.  But  |l  —  / 2 |  <  h 

implies  Y  >1,  and  |yi  -y^/2\  <  h  with  Y^  >  1  implies  Y2  >1»  and  so  on  until 

-Ot 

we  reach  Y  > 1  in  which  case  the  last  term  is  not  less  than  2  .  We  now 

n 

have  that  {X,  :  kin}  forms  a  basis  for  L  . 

k  n 

Under  the  assumption  that  X  does  in  fact  have  a  right  Wold  decompo- 

n 

i  00 

sit  ion,  we  may  write  E(X  ..X  ,X  ,,...)  =  X  for  some  choice  of 

’  n+1  n  n-1  k=0  k  n-k 

OO 

{A.  } .  Also,  the  A,  must  satisfy  X  ,  J.  X  -  I,  ~  A  X  .  for  all  j  >  0  by 
k  ’  k  n-j  n+1  k=0  k  n-k  J  J 

Proposition  1.5.  This  requirement  is  equivalent,  by  Lemmata  1.1  and  1.2,  to 


n-j  'n+1  d;  k  n-k' 


<P-1> 


=  Ed  .  -  2K  .  ,)  P  (C  ..  -  2£  -  I  A,(£  ,  -2£  .)) 

n-i  n-j-1  n+1  n  ,  „  k  n-k  n-k-1 

j  j  k=0 


=  cPd+Z^P701"1  • 


-2  -  (1  +2a)A0  +  2a_1X1,  j  =  0, 


[  2X  -  Cl  +  2a)X.  +  2a  1X.i1,  j  >0. 
J-l  J  3+1 


Thus  X  must  satisfy 

K 


Xx  =  22_a  +  2(l  +2  a)A0, 


Vi  ■ 2(1  +  2"X  -  k>0- 


A  solution  to  these  equations  is  determined  by  specifying  A  .  The  solution 


for  k  >0  is 


XR  =  2k(l  -  2  a) ~ 1  [ 2 1  —Gt ( 1  -  2  ak)  +  (1  -  2  a(k+1))X0] 


It  is  easily  seen  that  lim|X  |  =  00  unless  X  = -2  .  Hence  we  must  have  that 

k-x”  U 


Ak  =  -(21_a)k+1 


and  furthermore  that 


X  -  l  A,  X  =  £  , 

n+1  .  n  k  n-k  n+1 

k=0 


L  -  2(1  -  2~a)  l  (2 1-a)\ 

k=0 


n-k 


To  obtain  our  contradiction,  recall  that  all  of  L  (not  just  each  X  .)  must 

n  J  n-j 

OO 

be  orthogonal  to  X  ,,  -  Z,  _X.  X  .  .  Check  that  for  i  >0» 
n+1  k=0  k  n-k  J 

OO 

E(X  .  +  X  1)<P"1>(X  -  y  A,X  .  ) 

n-j  n-j -1  n+1  k^Q  k  n-k 


•  «C„.j  -  -  «n.j.2)<P'1>(«ft+1  -  ™ 


,1-a, k 
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=  (const  ^  0)[1  -  21-a-2a  1(21-a)2] 
=  (const  ^  0) [1  -  22  a], 


which  is  non-zero  for  a  <2,  completing  the  proof  that  no  right  Wold  decompo¬ 
sition  exists. 

To  show  1 X  }  has  a  left  Wold  decomposition,  it  suffices  bv  Theorem  2.10  to 
n 

show  that  the  operators  are  linear.  Clearly  these  operators  are  linear  if 
and  only  if  they  are  linear  on  each  L^,  M  <  °°.  By  our  arguments  above,  {X^} 
is  a  basic  set.  It  is  thus  a  simple  matter  to  show,  in  view  of  Proposition 
2.6,  that  P^  is  linear  on  if  and  only  if 

M  M 


(•:•) 


Pn(  E  \V  =  *  VnV 

k=n+l  k=n+l 


Since  X^  is  by  definition  independent  of  (and  thus  orthogonal  to)  for 

k  a  n  +  2,  the  RHS  of  ( t)  is  just  a  ,,P  X  or  P  (a  X  by  Propositions 

n+I  n  n+1  n  n+i  n+i 

2.5  and  2.6.  Recall  (Proposition  2.4)  that  P  (a  X  ,,)  is  the  unique  Y  <  L 

n  n+1  n+1  n 

satisfying 


«VlVl  -  Y><P'1\  -  »  tor  Is*. 

The  LHS  of  ( t)  is  likewise  the  unique  Y'  t  satisfying 
M  ,  . 

E(  J  a  X  -  Y')  P  X„  =  0  for  £  ■  n. 
k=n+l  k 

Now  represent  (Y',X  .  -°°  <  n  <  *>}  by  lg'  ,f  :  <  n  <  and  recall  that 

n  n 

independence  of  XR  and  X^  for  |k  -  £|  i  1  is  equivalent  to  f^  and  f  having 
almost  disjoint  support  tor  like  indices.  Thus  for  t  <  n, 


0  =  E(  )  a.  X.  -  Y')  1  X, 
i  k  k  l 

k=n+l 


=  (const.  4  0)/(  l  a^f  ^  -  g')<0t  ^f^di 
k=n+l 

=  (const.  4  °)/(an+1fn+1  "  S'>  X  1  f^,dm 


=  (const.  4  0)E(an+1Xn+1  -  Y')<p-1>X^. 


Hence  Y  =  Y  ’  (i.e.  (t)  holds)  and  {X^}  has  a  left  Wold  decomposition. 

For  the  sake  of  completeness,  we  also  compute  this  left  Wold  decomposition. 

f  1  00 

Since  (X  )  is  basic,  we  must  have  that  P  X  , ,  =  Z,  „A,  X  ,  for  some  choice  of 
n  n  n+1  k=0  k  n-k 

[A,  }•  Analogous  to  what  was  done  for  the  right  Wold  decomposition  for  this  pro 

CO 

cess,  we  may  use  the  orthogonality  relations  X  , ,  -  L  „A,  X  ,  i  X„  for  l  <  n 

n+1  k=0  k  n-k  l 

to  derive  equations  which  {A^}  must  satisfy.  We  omit  the  details,  and  state 
only  that  the  analogous  arguments  show  that 


AR  =  -(21~Ct)k+1 


provides  the  unique  solution  to  these  equations  for  which  £A,  X  ,  converges. 

k  n-k 

Hence  the  left  Wold  decomposition  for  this  process  is  given  by:  L  =  { 0 } ; 


1  _ 

N  =  sp{ I  }  where  I  =  £  (21  a)kX  ,  ;  and  X  =  1^  -  21  “l^ 

n  n  n  k=0  n-k  n  n  n- 


Kxample  A. 3.  All  sub-Gaussian  sequences  have  identical  right  and  left  Wold 
decompositions,  yet  never  have  independent  Wold  decompositions. 

Proof .  Any  sub-Gaussian  process  {X^}  may  be  represented  as  Xn=A^Gn>  where 
{ G  }  is  a  mean-zero  Gaussian  process  and  A  is  a  positive  a/2-stable  variable. 


4.7 


independent  of  {g  }.  Let  L*  =  sp(G,  :  k^n),  and  let  L'  =  L'  ©  L.  _  ©  N'  . 

n  n  r  k  n  k=0  n-k 

be  the  standard  (independent)  Wold  decomposition  of  (c^).  Then 

L_  L 

L  =  AT.'  L  =  A  L'  :  and  letting  N,  =  An'  we  have  the  decomposition 
n  n  -°°  &  k  k  1 

OO 

L^  =  L  m  That  this  decomposition  possesses  the  appropriate 

orthogonalities  follows  from  the  fact  that  if  A,  Z^ ,  and  7.  are  independent 

L  U 

with  Z^,Z2  mean-zero  Gaussian,  then  A  and  A^Z^  are  two-sided  orthogonal: 
E(A1'5Z1)<p-1>(AisZ2)  =  EAP/2Z1<P'1>Z2  =  EAP/2*EZ1<P_1>EZ2  =  0. 


The  decomposition  cannot  be  independent,  since  contains  no  non-trivial 
independent  random  variables  (cf.  Lemma  2.1  in  [  1  ]).  D 

Example  4.4.  Let  {£  }  be  i.  i.d .  SaS,  l<a<2.  Let  0  <  |  A  |  <  1  and  define 

00  k 

X  =  (  ,  .  Then  {X  }  has  a  right  Wold  decomposition,  but  has  no  inde- 

n  k=u  n+k  n 


pendent  or  left  Wold  decomposition 

<u-l> 


Proof.  Let  y =  A 


y  k . 


and  define  Z  = X  -  yX  , .  Since  X  =  L  n  Z  ,  ,  we 
n  n  n-1  "  v-n  "  1 


n  “  k=0  n-k 


have  L^  =  sp{X^:  k  <nl  =  sp{Z^:  k<n}.  We  claim  that  {Z^}  is  not  an  indepen- 

OO 

dent  sequence,  yet  has  a  right  Wold  decomposition  L  =  L,  _  ®  N  ,  ,  where 

n  k=0  •*-  n-k 


X  .  =  sp{Z . } . 
.1  J 


Note  Zn  =  -A  a  ^  £,n  ^  +  (1  -  |  A|a)Z^_oA^n+jt.  Represent  {£,  }  by  {i^}. 


a,  “  ,  k. 


I.  -  .  .Ilt  so  that  {Z  }  is  represented  by  {f  },  where 

J  U,J+1J  n  r  n 

OO 

+  (i  -  IM“>  l  xki, 


f  =  -A 
n 


k=0 


n+k  - 


Note  also  that  since  £  =  X.  -  AX .  ,  we  have  L  =  sp{...,£  „,£  , ,X  }. 

J  J  J+l  n  n-2  n-1  n 

N 

The  following  calculation  shows  anX  +  I,  ,a,  £  ,  J.  Z  , ,  for  any  choice  of 

On  k=l  k  n-k  n+1 

a.  and  hence  that  L  l  Z  • 

J  n  n+1 
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{jVj/W  +  J  akIn-k1<u‘l>f„+id"' 

H  j=0  J  k=l 


<CK  - 1  >  (r  r  ,,j.<Ot-l>,  r  ,<a-l>.  , .  I.ia,  V  u 

)  /[  I  in+iH-A  I  +  a  -  |A|  )  5;  A  I  Jdr 

’  IR  j=n  n  J  n  k=0  n  K  1 


=  a_<a_1>t-X<Ct-1>  +  (1  -  |  X  |a)  l  Ak(Ak+1)<a-1>l 

k=0 


<a-l>r  , <a-l> 


[_X—  +  (1  -  1  X  I01)  X-1  I  |  X 

k-0 


I  ct  (  k+1 ) 


Now  observe  that 

E(X  |x  ,X  =  E(Z  +A<a_1>X  |X  ,X  =  A<a-1>X  . 

n+1  n  n-1  n+1  n1  n  n-1  n 

Hence  {X  }  has  a  right  Wold  decomposition  by  Theorem  2.3.  However,  the  spaces 

are  independent,  since  4  0  a.e.  (It  is  also  clear  that  X^  is 

not  a  sub-Oaussian  process,  since  contains  independent  random  variables.) 

We  now  wish  to  show  {X^}  has  no  left  Wold  decomposition.  We  do  this  by 

showing  that  condition  (iii)  of  Theorem  2.10  is  violated.  To  this  end,  let 

P  be  the  metric  projection  onto  L  .  We  show  that  there  are  constants  b, 
n  r  J  n  1 

and  b  such  that  P  X  .  =  b  X  and  P  X  =  b„X  yet 
2  n  n+1  In  n  n+2  2  n 


P  ,P  X  i.)  =  P  X  .  =  b_X  4  b.X  =  P  P  ,.X 

n+1  n  n+2  n  n+2  2  n  In  n  n+1  n+2 


showing  P^  does  not  coninute  with  Pn+^* 

GO 

Let  Y  =PX  . ,  j  =  1,2.  Then  necessarily  Y  =  b,X  +  E,  .a,  E  ,  ,  since 
j  n  n+j  1  1  n  k=l  k  n-k 

L  =  sp{x  ,f,  ,  ,E  „,...)  and  {X  ,E  ..  ,E  ,,...)  is  a  basic  set.  By  Proposi- 

n  n  n-1  n-2  n  n-1’  n-2 

tion  2.4,  Y.  must  satisfy  X  -  Y,  l  L  .  The  requirement  X  - Y  it,.,  jin-1, 
’  1  n+1  In  n+1  1  j 


impl ies 


OO 

0  =  E(X  ^  -  b.X  -  y  a,  E  .)<P_1>E. 

n+1  In  ,  '  k  n-k  j 

k=l  J 


To  find  b  ,  notj  that 


which  in  turn  implies  a.  =0  for  all  i,  and  Y,  =  b, X  . 

3  J  1  1  n 

~1  oo  k. 

X  -  b,  X  = -b,  £,  +(A  -b,  )£,  ,  A  ,  and  compute 

nln  In  lk=l  n+k  r 


<n— 1  > 

0  =  E(X  -  b.X  )  p  X 
n+1  In  n 


=  (const.  4  0)  [-b  ^  *"  +  ( A  A  -  b  )  ^  \  (A  )  A  \ 

1  1  k=l 


=  (const.  4  0)  [-b^  1  +  (X  1  -  b^) <a  1>jx|a(l  -  |x|a)  I] 


|0L_1- 


Solve  for  b^  to  get 


bl=  A 


Cl  X 1  ) 


a  q 


(1- | A |a) q  +  ( | A |a)  q 


A  1 

,  q  = 


a-l  * 


Using  the  same  methods,  we  find  that  Y  =b  X  where 

2  2  n 


b  =  _L  _ UALV- _ . 

2  A2  (l-|x|2a)q+  (|A|2a)q 

2 

Now,  b^  =  b^  if  and  only  if 

(1  -  |X|2V  +  (|x|2a)q  =  [(1  -  |A|a)q  +  (  I  A  I a) q  J 2  , 

if  and  only  if 

(1+  |A|a)q  =  (1  -  |A|a)q  +  2(|A|V. 

Since  1  < a  <  2  and  0  <  | A |  < 1,  we  have  that  q  > 1  and 

(1  -  | A | W)q  +  2 ( | A |a)q  <  11  -  |A|a  +  21/q | A |a]q 

<  [l  +  !A|a]q. 


2 

This  shows  b„  4  b,  and  hence  that  {x  }  cannot  have  a  left  Wold  decomposition,  jj 
1  1  n 


Example  4.5.  The  stationary  sequence  X  =  /  TTe^n^dZ(A)  is  orthogonal 


but 


has  no  right  or  left  or  independent  Wold  decomposition. 


Proof  .  Since  for  m/n,  /  (elm  ) 

that  X  iX  . 
m  n 


f77  -imA  in  A,.  „  .  .  , , 

dA  =  J  e  e  dA  =  0,  it  follows 


We  show  that  sp{x  „,X  ,  }  is  not  orthogonal  to  X  ,  i.e.  that 

n-2  n-1  n 

/ir  (.a  +  be*  )  1  e^2\lA  does  not  equal  zero  for  all  a  and  b.  Taking  a=b, 

we  have 


(*) 


A  V  iA  <a-l>  i2A  _  ^  (1+e  i>l)ei2A 

I  =  /U  +  e  )  e  dA  -  J  dA 

-Tt  -TT  1  +  e 


a/2  r  cos  2  A  +  cos  A 


=  2U/Z  / 


0(1+  cos  A) 


1-0/2 


dA. 


The  numerator  of  the  integrand  vanishes  at  6  with  cos  0  = %,  is  positive  on 
[0,0)  and  negative  on  (0,tt),  and  of  course  J^(cos  2  A  +  cos  A)d A  =  0.  We  thus 
have 


(**) 


I  .  2“/2{/  +  /)  +  dX 


0  0  (1  +  cos  A) 


l-a/2 


?a/2  0  ft 

- i — ~PT  {/  +  /Hcos  2  A  +  cos  A)  dA 

(1  +cos  9)i_a/2  0  0 


=  0. 


Assume  that  {X  }  has  right  innovations,  i.e.  L  =  L  ®  N  Then 
n  n  n-1  *  n‘ 

X  =  Y  +  Z  where  Y  t_  L  ,  and  L  ,  i  Z  =  X  -  Y.  A  straightforwaro  adapta 
n  n  n  n  n-l  n-1  n  n  n 

tion  of  Theorem  7.1  of  [11]  shows  that  {X,  ,  k  s  n}  forms  a  basis  in  L  (see 

k  n 

(see  [1,  p.  606])  so  that  Yn  =  ^n-lW  the  series  converging  in  every 
Lp,  P  <ot*  Then  \  iXn -Yn>  ^$n-l,  implies  ak  =  0,  i.e.  Yr  =  0,  so  that 

Ln-liXn  and  Sp^Xn-2,Xn-l^  iXn  contradictinS  °ur  earlier  result.  Thus  {X^} 
has  no  right  innovations  and  no  right  Wold  decomposition. 

The  orthogonality  of  the  X^s  implies  and  thus  the  best  approxi¬ 

mation  to  Xn  in  ,  k<n-l,  is  the  zero  clement.  It  follows  that  the  left 


innovations  space  L  =  L  ,  N  is  N  =  sp{X  }.  However  N  ®  N  is  not 

n  n-1  '  n  n  n  n-1  n 

orthogonal  to  ^ ,  so  no  left  Wold  decomposition  exists.  This  is  so  because 

X  +  X  ,  is  not  orthogonal  to  X  „  as 
n  n-1  n-2 


7  „im-l)A^<n[-l>„i(n-2)XdX  =  j  (1  + 


(e  +  e 


)  c 


=  I  <  0 


from  (*)  and  (**) . 

That  {x  }  has  no  independent  Wold  decomposition  follows  from  the  above, 
but  also  follows  immediately  from  part  (iii)  of  Theorem  3.1  and  the  fact  that 


each  f  (A)  =  e  has  as  support  the  entire  interval  [— tt.tt]  , 


r 
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